The NEW ENGLAND JOURNAL of MEDICINE 


| ORIGINAL ARTICLE | 


Safety of the BNT162b2 mRNA Covid-19 


Vaccine in a Nationwide Setting 


Noam Barda, M.D., Noa Dagan, M.D., Yatir Ben-Shlomo, B.Sc., 
Eldad Kepten, Ph.D., Jacob Waxman, M.D., Reut Ohana, M.Sc., 
Miguel A. Hernan, M.D., Marc Lipsitch, D.Phil., Isaac Kohane, M.D., 
Doron Netzer, M.D., Ben Y. Reis, Ph.D., and Ran D. Balicer, M.D. 








ABSTRACT 





BACKGROUND 
Preapproval trials showed that messenger RNA (mRNA)-based vaccines against 
severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) had a good safety 
profile, yet these trials were subject to size and patient-mix limitations. An evaluation 
of the safety of the BNT162b2 mRNA vaccine with respect to a broad range of po- 
tential adverse events is needed. 


METHODS 
We used data from the largest health care organization in Israel to evaluate the 
safety of the BNT162b2 mRNA vaccine. For each potential adverse event, in a popu- 
lation of persons with no previous diagnosis of that event, we individually matched 
vaccinated persons to unvaccinated persons according to sociodemographic and 
clinical variables. Risk ratios and risk differences at 42 days after vaccination were 
derived with the use of the Kaplan-Meier estimator. To place these results in con- 
text, we performed a similar analysis involving SARS-CoV-2-infected persons 
matched to uninfected persons. The same adverse events were studied in the vac- 
cination and SARS-CoV-2 infection analyses. 


RESULTS 
In the vaccination analysis, the vaccinated and control groups each included a mean 
of 884,828 persons. Vaccination was most strongly associated with an elevated risk of 
myocarditis (risk ratio, 3.24; 95% confidence interval [CI], 1.55 to 12.44; risk differ- 
ence, 2.7 events per 100,000 persons; 95% CI, 1.0 to 4.6), lymphadenopathy (risk ratio, 
2.43; 95% CI, 2.05 to 2.78; risk difference, 78.4 events per 100,000 persons; 95% CI, 
64.1 to 89.3), appendicitis (risk ratio, 1.40; 95% CI, 1.02 to 2.01; risk difference, 
5.0 events per 100,000 persons; 95% CI, 0.3 to 9.9), and herpes zoster infection (risk 
ratio, 1.43; 95% CI, 1.20 to 1.73; risk difference, 15.8 events per 100,000 persons; 
95% CI, 8.2 to 24.2). SARS-CoV-2 infection was associated with a substantially in- 
creased risk of myocarditis (risk ratio, 18.28; 95% CI, 3.95 to 25.12; risk difference, 
11.0 events per 100,000 persons; 95% CI, 5.6 to 15.8) and of additional serious ad- 
verse events, including pericarditis, arrhythmia, deep-vein thrombosis, pulmonary 
embolism, myocardial infarction, intracranial hemorrhage, and thrombocytopenia. 


CONCLUSIONS 
In this study in a nationwide mass vaccination setting, the BNT162b2 vaccine was 
not associated with an elevated risk of most of the adverse events examined. The 
vaccine was associated with an excess risk of myocarditis (1 to 5 events per 100,000 
persons). The risk of this potentially serious adverse event and of many other serious 
adverse events was substantially increased after SARS-CoV-2 infection. (Funded by 
the Ivan and Francesca Berkowitz Family Living Laboratory Collaboration at Harvard 
Medical School and Clalit Research Institute.) 
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ORE THAN 1 YEAR INTO THE PAN- 

demic of coronavirus disease 2019 

(Covid-19), the disease caused by severe 
acute respiratory syndrome coronavirus 2 (SARS- 
CoV-2), an unprecedented number of mass vac- 
cination efforts are under way worldwide. Glob- 
ally, nearly 3.4 billion doses of vaccine have been 
administered over the 6-month period since the 
first vaccines were approved.’ 

Phase 3 clinical trials showed that several 
Covid-19 vaccines were efficacious and had an 
acceptable safety profile.** A number of poten- 
tial adverse events were identified during these 
trials, including lymphadenopathy and idiopathic 
facial-nerve (Bell’s) palsy.” Trials of the BNT162b2 
vaccine (Pfizer-BioNTech) also showed a mild 
imbalance between the vaccinated and placebo 
groups with respect to the number of cases of 
appendicitis, hypersensitivity reactions, acute myo- 
cardial infarction, and cerebrovascular accidents.° 
However, phase 3 trials may have inherent limi- 
tations in assessing vaccine safety because of a 
small number of participants and a healthier-than- 
average sample population. Hence, they are often 
underpowered to identify less common adverse 
events. Postmarketing surveillance is required to 
monitor the safety of new vaccines in real-world 
settings. 

Much effort is currently focused on character- 
izing the safety profiles of the recently approved 
Covid-19 vaccines. Passive surveillance systems 
such as the Vaccine Adverse Event Reporting Sys- 
tem (VAERS)° collect information about adverse 
events that are potentially related to vaccination. 
This information is voluntarily reported by health 
care providers and the public. These systems are 
useful for quickly identifying potential safety 
signals, which, along with the findings of phase 3 
trials, can be translated to lists of adverse events 
of interest for further exploration (such as that 
provided by the Safety Platform for Emergency 
Vaccines [SPEAC]).”* Active surveillance systems 
such as the Biologics Effectiveness and Safety 
(BEST) system (part of the Sentinel Initiative)? 
aim to compare the incidence of adverse events 
of interest in large electronic health record data- 
bases with the background historical incidence. 
Although active surveillance can help highlight 
suspicious trends, the lack of a rigorously con- 
structed comparable control group limits the abil- 
ity of such surveillance to identify causal effects 
of vaccination. 
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The effectiveness of vaccines against SARS- 
CoV-2 has been confirmed in real-world stud- 
ies, ®" but high-quality real-world safety data on 
the messenger RNA (mRNA)-based Covid-19 
vaccines remain relatively sparse in the literature. 
The results of a study based on data reported by 
more than 600,000 vaccinated persons were re- 
cently published’; that study mainly assessed 
common and mild side effects. Two additional 
studies, which were based on surveys of vaccinated 
participants, involved small cohorts,'*”* and an- 
other study analyzed adverse events reported in 
the VAERS database.” All these studies lacked 
controls. One study that did incorporate a con- 
trol group included 8533 long-term care facility 
residents who had received the first dose of vac- 
cine. The authors of this study concluded that 
the mRNA-based vaccines had an acceptable safety 
profile, and no notable adverse events were re- 
ported. 

As of May 24, 2021, nearly 5 million people in 
Israel, comprising more than 55% of the popula- 
tion, had received two doses of the BNT162b2 
vaccine.’ In this study, we used the integrated 
data repositories of the largest health care orga- 
nization in Israel to evaluate the safety profile of 
the BNT162b2 vaccine. We compared the incidence 
of a broad set of potential short- and medium- 
term adverse events among vaccinated persons 
with the incidence among matched unvaccinated 
persons. Potential adverse events related to medi- 
cal interventions are best understood in the con- 
text of the risks associated with the disease that 
these interventions aim to prevent or treat, so we 
also estimated the effects of SARS-CoV-2 infection 
on this same set of adverse events. 





METHODS 





STUDY SETTING 
We analyzed observational data from Clalit Health 
Services (CHS) in order to emulate a target trial 
of the effects of the BNT162b2 vaccine on a broad 
range of potential adverse events in a population 
without SARS-CoV-2 infection. CHS is the larg- 
est of four integrated payer—provider health care 
organizations that offer mandatory health care 
coverage in Israel. CHS insures approximately 
52% of the population of Israel (>4.7 million of 
9.0 million persons), and the CHS-insured popu- 
lation is approximately representative of the Israeli 
population at large.” CHS directly provides out- 
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patient care, and inpatient care is divided between 
CHS and out-of-network hospitals. CHS informa- 
tion systems are fully digitized and feed into a 
central data warehouse. Data regarding Covid-19, 
including the results of all SARS-CoV-2 poly- 
merase-chain-reaction (PCR) tests, Covid-19 di- 
agnoses and severity, and vaccinations, are col- 
lected centrally by the Israeli Ministry of Health 
and shared with each of the four national health 
care organizations daily. 

This study was approved by the CHS institu- 
tional review board. The study was exempt from 
the requirement for informed consent. 


ELIGIBILITY CRITERIA 
Eligibility criteria included an age of 16 years or 
older, continuous membership in the health care 
organization for a full year, no previous SARS- 
CoV-2 infection, and no contact with the health 
care system in the previous 7 days (the latter cri- 
terion was included as an indicator of a health 
event not related to subsequent vaccination that 
could reduce the probability of receiving the vac- 
cine). Because of difficulties in distinguishing the 
recoding of previous events from true new events, 
for each adverse event, persons with a previous 
diagnosis of that event were excluded. 

As in our previous study of the effectiveness 
of the BNT162b2 vaccine,” we also excluded 
persons from populations in which confounding 
could not be adequately addressed — long-term 
care facility residents, persons confined to their 
homes for medical reasons, health care workers, 
and persons for whom data on body-mass index 
or residential area were missing (missing data for 
these variables are rare in the CHS data). A com- 
plete definition of the study variables is included 
in Table S1 in the Supplementary Appendix, avail- 
able with the full text of this article at NEJM.org. 


STUDY DESIGN AND OVERSIGHT 
The target trial for this study would assign eligi- 
ble persons to either vaccination or no vaccina- 
tion. To emulate this trial, on each day from the 
beginning of the vaccination campaign in Israel 
(December 20, 2020) until the end of the study 
period (May 24, 2021), eligible persons who were 
vaccinated on that day were matched to eligible 
controls who had not been previously vaccinated. 
Since the matching process each day considered 
only information available on or before that day 
(and was thus unaffected by later vaccinations or 


SARS-CoV-2 infections), unvaccinated persons 
matched on a given day could be vaccinated on 
a future date, and on that future date they could 
become newly eligible for inclusion in the study 
as a vaccinated person. 

In an attempt to emulate randomized assign- 
ment, vaccinated persons and unvaccinated con- 
trols were exactly matched on a set of baseline 
variables that were deemed to be potential con- 
founders according to domain expertise — 
namely, variables that were potentially related to 
vaccination and to a tendency toward the devel- 
opment of a broad set of adverse clinical condi- 
tions. These matching criteria included the socio- 
demographic variables of age (categorized into 
2-year age groups), sex (male or female), place of 
residence (at city- or town-level granularity), socio- 
economic status (divided into seven categories), 
and population sector (general Jewish, Arab, or 
ultra-Orthodox Jewish). In addition, the matching 
criteria included clinical factors to account for 
general clinical condition and disease load, in- 
cluding the number of preexisting chronic con- 
ditions (those considered to be risk factors for 
severe Covid-19 by the Centers for Disease Con- 
trol and Prevention [CDC] as of December 20, 
2020,'* divided into four categories), the number 
of diagnoses documented in outpatient visits in 
the year before the index date (categorized into 
deciles within each age group), and pregnancy 
status. 

All the authors designed the study and critically 
reviewed the manuscript. The first three authors 
collected and analyzed the data. A subgroup of 
the authors wrote the manuscript. The last author 
vouches for the accuracy and completeness of the 
data and for the fidelity of the study to the pro- 
tocol. There was no commercial funding for this 
study, and no confidentiality agreements were in 
place. 


ADVERSE EVENTS OF INTEREST 

The set of potential adverse events for the target 
trial was drawn from several relevant sources, 
including the VAERS, BEST, and SPEAC frame- 
works, information provided by the vaccine man- 
ufacturer, and relevant scientific publications. 
We cast a wide net to capture a broad range of 
clinically meaningful short- and medium-term 
potential adverse events that would be likely to 
be documented in the electronic health record. 
Accordingly, mild adverse events such as fever, 
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Figure 1 (facing page). Study Population for the 
Vaccination Analysis. 


Absolute numbers and percentage changes are shown 
for each inclusion and exclusion criterion. The chart 
focuses on the vaccinated population. The derivation 
group includes the entire population, including unvac- 


cinated persons. The shaded boxes indicate the two 
study groups. The same exclusion criteria were applied 
to the unvaccinated persons for each index date on 
which they were considered for matching. BMI denotes 
body-mass index, CHS Clalit Health Services, and PCR 
polymerase chain reaction. 


malaise, and local injection-site reactions were 
not included in this study. The study included 42 
days of follow-up, which provided 21 days of 
follow-up after each of the first and second vac- 
cine doses. A total of 42 days was deemed to be 
sufficient for identifying medium-term adverse 
events, without being so long as to dilute the 
incidence of short-term adverse events. Similarly, 
adverse events that could not plausibly be diag- 
nosed within 42 days (e.g., chronic autoimmune 
disease) were not included. 

Adverse events were defined according to di- 
agnostic codes and short free-text phrases that 
accompany diagnoses in the CHS database. A 
complete list of the study outcomes (adverse 
events) and their definitions is provided in Ta- 
ble S2. 

For each adverse event, persons were followed 
from the day of matching (time zero of follow-up) 
until the earliest of one of the following: docu- 
mentation of the adverse event, 42 days, the end 
of the study calendar period, or death. We also 
ended the follow-up of a matched pair when the 
unvaccinated control received the first dose of 
vaccine or when either member of the matched 
pair received a diagnosis of SARS-CoV-2 infection. 


RISKS OF SARS-COV-2 INFECTION 

To place the magnitude of the adverse effects of 
the vaccine in context, we also estimated the ef 
fects of SARS-CoV-2 infection on these same ad- 
verse events during the 42 days after diagnosis. 
We used the same design as the one that we used 
to study the adverse effects of vaccination, except 
that the analysis period started at the beginning 
of the Covid-19 pandemic in Israel (March 1, 2020) 
and persons who had had recent contact with the 
health care system were not excluded (because 





such contact may be expected in the days before 
diagnosis). 

Each day in this SARS-CoV-2 analysis, persons 
with a new diagnosis of SARS-CoV-2 infection 
were matched to controls who were not previ- 
ously infected. As in the vaccine safety analysis, 
persons could become infected with SARS-CoV-2 
after they were already matched as controls on a 
previous day, in which case their data would be 
censored from the control group (along with their 
matched SARS-CoV-2-infected person) and they 
could then be included in the group of SARS- 
CoV-2-infected persons with a newly matched 
control. Follow-up of each matched pair started 
from the date of the positive PCR test result of 
the infected member and ended in an analogous 
manner to the main vaccination analysis, this time 
ending when the control member was infected or 
when either of the persons in the matched pair 
was vaccinated. 

The effects of vaccination and of SARS-CoV-2 
infection were estimated with different cohorts. 
Thus, they should be treated as separate sets of 
results rather than directly compared. 


STATISTICAL ANALYSIS 
Because a large proportion of the unvaccinated 
controls were vaccinated during the follow-up 
period, we opted to estimate the observational 
analogue of the per-protocol effect if all unvac- 
cinated persons had remained unvaccinated dur- 
ing the follow-up. To do so, we censored data on 
the matched pair if and when the control member 
was vaccinated. Persons who were first matched 
as unvaccinated controls and then became vac- 
cinated during the study period could be included 
again as vaccinated persons with a new matched 
control. The same procedure was followed in the 
SARS-CoV-2 infection analysis (i.e., persons who 
were first matched as uninfected controls and then 
became infected during the study period could 
be included again as infected persons with a new 
matched control). 

We used the Kaplan-Meier estimator’ to con- 
struct cumulative incidence curves and to estimate 
the risk of each adverse event after 42 days in each 
group. The risks were compared with ratios and 
differences (per 100,000 persons). 

In the vaccination analysis, so as not to at- 
tribute complications arising from SARS-CoV-2 
infection to the vaccination (or lack thereof), we 
also censored data on the matched pair if and 
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Table 1. Baseline Characteristics of the Study Populations According to Vaccination Status and SARS-CoV-2 Infection Status.* 





Characteristic Vaccination Analysis SARS-CoV-2 Analysis 


Vaccinated Control SARS-CoV-2— Control 
Group Group Infected Group Group 
(N=884,828) (N=884,828) (N=173,106) (N=173,106) 


Median age (IQR) — yr 38 (27-53) 38 (27-53) 34 (24-47) 34 (24-47) 
Age group — no. (%) 

16-39 yr 472,095 (53 472,095 (53) 107,046 (62) 107,046 (62) 
40-49 yr 160,413 (18 160,413 (18) 28,738 (17) 28,738 (17) 
50-59 yr 93,110 (11 93,110 (11) 17,851 (10) 17,851 (10) 
( (10) (7 ( 
( ( (3 ( 
( ( ( ( 


1 


60-69 yr 87,236 (10 87,236 (10 12,100 7 
70-79 yr 51,924 (6 51,924 (6 33 7l 
280 yr 20,050 (2 20,050 (2 1,999 

Sex — no. (%) 

Female 423,238 (48) 423,238 (48) 93,263 (54) 93,263 (54) 
Male 461,590 (52) 461,590 (52) 79,843 (46) 79,843 (46) 

Population sector — no. (%) 

General Jewish 595,897 (67) 595,897 (67) 90,903 (53) 90,903 (53) 
Ultra-Orthodox Jewish 24,343 (3) 24,343 (3) 20,864 (12) 20,864 (12) 
Arab 264,588 (30) 264,588 (30) 61,339 (35) 61,339 (35) 


) 12,100 
) 5,371 
) 


1,999 


) 
3) 
1) 


) ) 
) ) 


No. of risk factors according to CDC criteria — no. (%) 
571,604 (65) 571,604 (65) 108,980 (63) 108,980 (63) 
200,789 (23) 200,789 (23) 41,502 (24) 41,502 (24) 
61,924 (7) 61,924 (7) 11,976 (7) 11,976 (7 
27,175 (3) 27,175 (3) 5,181 (3) 5,181 (3 
24 23,335 (3) 23,335 (3) 5,467 (3) 5,467 (3 


CDC “certain” risk criteria — no. (%) 


) 
) 
) 


Cancer 9957 (1 10,300 (1 
40,339 (5 
11,498 (1 


31,596 (4 


2,037 
8,269 (5 
WOT 
5,653 (3 


1 2,308 (1 
8,141 (5 
2,212 (1 


5,880 (3 


Chronic kidney disease 39,837 (4 


Chronic obstructive pulmonary disease 10,121 (1 


(1) (1) (1) (1) 
(4) (5) (5) (5) 
(1) (1) (1) (1) 
Heart disease 31,836 (4) (4) (3) (3) 
Solid-organ transplantation 351 (<1) 370 (<1) 148 (<1) 136 (<1) 
Obesity: BMI, 30 to 40 129,148 (15) 125,120 (14) 30,558 (18) 28,580 ( 
Severe obesity: BMI, =40 11,861 (1 12,568 (1 3,478 (2 3,107 (2 
(1 6,082 (1 4,959 (3 4,959 (3 
Sickle cell disease 140 (<1) 182 (<1) 0 (<1) 5 (<1) 
Smoking 157,803 (18) 187,822 (21) 18,899 (11) 30,376 (18) 
Type 2 diabetes mellitus 61,865 (7) 61,093 (7) 12,448 (7) 12,396 (7) 
CDC “possible” risk criteria — no. (%) 
Asthma 46,836 (5) 47,151 
Cerebrovascular disease 14,296 (2) 14,919 


) ) ) 
Pregnancy 6,082 (1) ) ) 


5) 
2) 
Hypertension 94,819 (11) 93,357 (11) 


2) 


( ( 

( ( 
Other respiratory disease 1,884 (<1) 1,961 (<1) 

( ( 

( ( 


Immunosuppression 15,430 (2) 15,433 





6 N ENGLJ MED NEJM.ORG 


The New England Journal of Medicine 
Downloaded from nejm.org on August 26, 2021. For personal use only. No other uses without permission. 
Copyright © 2021 Massachusetts Medical Society. All rights reserved. 


BNT162B2 MRNA VACCINE IN A NATIONWIDE SETTING 


Table 1. (Continued.) 





Characteristic 


Neurologic disease 

Liver disease 

Overweight: BMI, 25 to 30 
Thalassemia 


Type 1 diabetes mellitus 


Vaccination Analysis 


Control 
Group 
(N=884,828) 


Vaccinated 
Group 
(N=884,828) 


26,340 (3 
10,491 (1 


( 28,421 (3 
( 

284,904 (32) 
( 
( 


(3) 

12,558 (1) 

271,335 (31) 
(1) 
( 


) 
) 


5,884 (1) 
2,797 (<1) 


5,644 (1 
2,648 (<1) 


SARS-CoV-2 Analysis 


Control 
Group 
(N=173,106) 


SARS-CoV-2- 
Infected Group 
(N=173,106) 


5,194 (3 
2396 (i 


( 5,455 (3) 
( 

53,374 (3 
( 
( 


) 

) 2,600 (2) 

1) 50,038 (29) 

) 1,595 (1) 
763 (<1) 


1,599 (1 
694 (<1) 





* Statistics are based on means and distributions from a pool of all the adverse event—specific cohorts. Characteristics of the various study 
populations after application of all eligibility criteria and the matching process are listed. BMI denotes body-mass index (the weight in ki- 
lograms divided by the square of the height in meters), CDC Centers for Disease Control and Prevention, IQR interquartile range, RT-PCR 
reverse-transcriptase polymerase chain reaction, and SARS-CoV-2 severe acute respiratory syndrome coronavirus 2. 





when either member received a diagnosis of 
SARS-CoV-2 infection. Similarly, in the SARS- 
CoV-2 infection analysis, we censored data on the 
matched pair if and when either member was 
vaccinated. Additional details are provided in the 
Supplementary Methods 1 section in the Supple- 
mentary Appendix. 

We calculated confidence intervals using the 
nonparametric percentile bootstrap method with 
500 repetitions. As is standard practice for studies 
of safety outcomes, no adjustment for multiple 
comparisons was performed. Analyses were per- 
formed with the use of R software, version 4.0.4. 





RESULTS 





VACCINATION ANALYSIS 
A total of 1,736,832 persons were eligible for 
inclusion in the vaccination cohort (Fig. 1). The 
median age in the eligible cohort was 43 years 
(Table S3). The final size of the study population 
differed for each studied adverse event because 
of adverse event-specific exclusion of persons 
with a history of that event. On average, across 
the adverse event-specific cohorts, 72.4% of the 
eligible persons were successfully matched. Ta- 
ble 1 shows the baseline characteristics of the 
total study population, with the mean distribution 
of characteristics across the various adverse event- 
specific cohorts. The characteristics of each ad- 
verse event-specific cohort are provided in Table 
S4. The vaccination cohorts included a mean of 
884,828 vaccinated persons, with a median age of 
38 years (5 years younger than the median age 


of the eligible cohort). A total of 48% of the 
population was female. 

The effect of vaccination on the various po- 
tential adverse events included in this study is 
presented in Table 2. The risk was substantially 
higher on either the multiplicative (risk ratio) or 
additive (risk difference) scales in the vaccinated 
group than in the unvaccinated group for myo- 
carditis (risk ratio, 3.24; 95% confidence interval 
[CI], 1.55 to 12.44; risk difference, 2.7 events per 
100,000 persons; 95% CI, 1.0 to 4.6), lymphade- 
nopathy (risk ratio, 2.43; 95% CI, 2.05 to 2.78; 
risk difference, 78.4 events per 100,000 persons; 
95% CI, 64.1 to 89.3), appendicitis (risk ratio, 
1.40; 95% CI, 1.02 to 2.01; risk difference, 5.0 
events per 100,000 persons; 95% CI, 0.3 to 9.9), 
and herpes zoster infection (risk ratio, 1.43; 95% 
CI, 1.20 to 1.73; risk difference, 15.8 events per 
100,000 persons; 95% CI, 8.2 to 24.2). Vaccina- 
tion was substantially protective against adverse 
events such as anemia, acute kidney injury, in- 
tracranial hemorrhage, and lymphopenia. 

Figure S1 shows the cumulative incidence 
(risk) curves for each specific adverse event. Spikes 
in the incidence of lymphadenopathy were seen 
after both the first and second doses of vaccine, 
whereas the incidence of myocarditis spiked main- 
ly after the second dose of vaccine. 


SARS-COV-2 INFECTION ANALYSIS 

A total of 233,392 persons (median age, 36 years) 
were eligible to be included in the SARS-CoV-2 
infection cohort (Fig. 2). On average, across the 
adverse event-specific cohorts, 75.8% of the eli- 
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Table 2. Adverse Events Associated with SARS-CoV-2 Vaccination.* 





Adverse-Event Cohort Vaccinated Control Risk Ratio Risk Difference 
in Each Group Group Group (95% Cl) (95% Cl) 


no. of persons no. of events no. of events/100,000 persons 


0.44 (0.23 to 0.73 
0.79 (0.67 to 0.93 
1.40 (1.02 to 2.01 
0.89 (0.74 to 1.04 
0.95 (0.65 to 1.34 
1.32 (0.92 to 1.86 
0.84 (0.54 to 1.27 
0.87 (0.55 to 1.40 
1.13 (0.95 to 1.38 
1.20 to 1.73 


-4.6 (-7.8 to -1.8) 
anil ie -6.1) 
.0 (0.3 to 9.9) 
(-14.7 to 1.8) 
(-6.3 to 4.2) 
.5 (-1.1 to 7.8) 
(-5.3 to 2.0) 
(-4.5 to 2.7) 
8 (-1.9 to 12.4) 
15.8 (8.2 to 24.2) 
-2.9 (-5.6 to -0.5) 
78.4 (64.1 to 89.3) 
ee 
8 (-3.3 to 5.2) 
7( 
(-2 
Gt 
(-1 
0 (-1 
(-3 
(-3 
2 (3 
(-4 
0 (-1 
3 (-2 


Acute kidney injury 912,019 20 45 
Anemia 709,267 298 378 
Appendicitis 900,289 95 66 
Arrhythmia 856,152 284 
Arthritis or arthropathy 731,340 70 
Bell’s palsy 923,692 59 


6. 
0. 
Cerebrovascular accident 917,598 55 


1 
8 
6 
Deep-vein thrombosis 925,380 47 1 


-l. 
-1. 
Herpes simplex infection 876,328 
Herpes zoster infection 888,647 1.43 
Intracranial hemorrhage 933,130 0.48 (0.20 to 0.89 


( 

( 

( 

( 

( 

( 

( 

( 

( 

( 

( 
Lymphadenopathy 823,006 2.43 (2.05 to 2.78 
Lymphopenia 938,939 0.26 (0.00 to 1.03 

( 

( 

( 

( 

( 

( 

( 

( 

( 

( 

( 

( 


) 
) 
) 
) 
) 
) 
) 
) 
) 
) 
) 
) 
) 
) 


Myocardial infarction 892,785 1.07 (0.74 to 1.60 
Myocarditis 938,812 3.24 (1.55 to 12.44) 
Neutropenia 919,291 0.87 (0.46 to 1.66 

Other thrombosis} 932,469 
Paresthesia 827,478 
Pericarditis 936,197 


1.0 to 4.6) 

o 1.8) 
o -0.3) 
o 21.4) 
to 3.4) 
to 0.4) 
to 3.1) 
o 15.4) 
0 2.3) 
o 3.8) 
to 20.0) 


-0.5 
-2.2 
10.8 


0.46 (0.19 to 0.91 
1.12 (0.98 to 1.24 
1.27 (0.68 to 2.31 
0.56 (0.21 to 1.15 L 


) 

) 

) 

) 

Pulmonary embolism 937,116 ) 
0.99 (0.62 to 1.64) 
) 

) 

) 

) 


Seizure 913,091 
Syncope 858,068 
Thrombocytopenia 923,123 


1.12 (0.94 to 1.34 
0.94 (0.63 to 1.27 
1.27 (0.68 to 2.67 
1.12 (0.97 to 1.28 


=1.5 
-0.4 
-0.6 
Uveitis 933,217 
Vertigo 773,263 








* Estimates were calculated with the use of the Kaplan—Meier estimator 42 days after vaccination or SARS-CoV-2 infection. Confidence inter- 
vals (Cls) were estimated with the use of the percentile bootstrap method with 500 repetitions. 

| The “other thrombosis” category is a composite diagnosis that includes arterial embolism and thrombosis, venous embolism and thrombo- 
sis, vascular insufficiency of the intestine, portal-vein thrombosis, or cranial venous sinus thrombosis. 





gible persons were successfully matched. Ta- 
ble 1 shows the average distribution of charac- 
teristics in these cohorts, across the two study 
groups (infected and noninfected). The charac- 
teristics of each adverse event-specific cohort 
are provided in Table S5. The cohorts for the 
analysis of SARS-CoV-2 infection comprised a 
mean of 173,106 SARS-CoV-2-infected persons 
(median age, 34 years). A total of 54% of these 
persons were female. 

Table S6 shows the effect of SARS-CoV-2 in- 
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fection on the incidence of various adverse events. 
Infection substantially increased the risk of many 
different adverse events, including myocarditis 
(risk ratio, 18.28; 95% CI, 3.95 to 25.12; risk dif 
ference, 11.0 events per 100,000 persons; 95% CI, 
5.6 to 15.8), acute kidney injury (risk ratio, 14.83; 
95% CI, 9.24 to 28.75; risk difference, 125.4 events 
per 100,000 persons; 95% CI, 107.0 to 142.6), 
pulmonary embolism (risk ratio, 12.14; 95% CI, 
6.89 to 29.20; risk difference, 61.7 events per 
100,000 persons; 95% CI, 48.5 to 75.4), intracra- 
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nial hemorrhage (risk ratio, 6.89; 95% CI, 1.90 to 
19.16; risk difference, 7.6 events per 100,000 per- 
sons; 95% CI, 2.7 to 12.6), pericarditis (risk ratio, 
5.39; 95% CI, 2.22 to 23.58; risk difference, 10.9 
events per 100,000 persons; 95% CI, 4.9 to 16.9), 
myocardial infarction (risk ratio, 4.47; 95% CI, 
2.47 to 9.95; risk difference, 25.1 events per 
100,000 persons; 95% CI, 16.2 to 33.9), deep- 
vein thrombosis (risk ratio, 3.78; 95% CI, 2.50 to 
6.59; risk difference, 43.0 events per 100,000 
persons; 95% CI, 29.9 to 56.6), and arrhythmia 
(risk ratio, 3.83; 95% CI, 3.07 to 4.95; risk differ- 
ence, 166.1 events per 100,000 persons; 95% CI, 
139.6 to 193.2). 


BOTH ANALYSES 
Figure 3 shows estimated risk ratios in both the 
vaccination and SARS-CoV-2 infection analyses 
for adverse events in which vaccination or infec- 
tion substantially increased the risk. Figure 4 
shows the absolute risk associated with vaccina- 
tion, alongside the absolute risk associated with 
SARS-CoV-2 infection, for the same adverse events. 





DISCUSSION 





We used a data set involving more than 2.4 mil- 
lion vaccinated persons from an integrated health 
care organization to evaluate the safety profile of 
the BNT162b2 mRNA Covid-19 vaccine. The main 
potential adverse events identified included an 
excess risk of lymphadenopathy (78.4 events per 
100,000 persons), herpes zoster infection (15.8 
events), appendicitis (5.0 events), and myocarditis 
(2.7 events). 

To place these risks in context, we also exam- 
ined data on more than 240,000 infected persons 
to estimate the effects of a documented SARS- 
CoV-2 infection on the incidence of the same ad- 
verse events. SARS-CoV-2 infection was not es- 
timated to have a meaningful effect on the 
incidence of lymphadenopathy, herpes zoster 
infection, or appendicitis, but it was estimated to 
result in a substantial excess risk of myocarditis 
(11.0 events per 100,000 persons). SARS-CoV-2 
infection was also estimated to substantially 
increase the risk of several adverse events for 
which vaccination was not found to increase the 
risk, including an estimated excess risk of ar- 
rhythmia (166.1 events per 100,000 persons), 
acute kidney injury (125.4 events), pulmonary 


embolism (61.7 events), deep-vein thrombosis 
(43.0 events), myocardial infarction (25.1 events), 
pericarditis (10.9 events), and intracranial hem- 
orrhage (7.6 events). 

An association between Covid-19 vaccination 
and myocarditis has been previously reported.” 
Although no cases of myocarditis were reported 
in the BNT162b2 (Pfizer—BioNTech),? mRNA-1273 
(Moderna), or ChAdOx1 nCoV-19 (AstraZeneca)* 
phase 3 clinical trials, multiple cases of myocar- 
ditis after Covid-19 vaccination have recently been 
reported in the literature,” and both the Israeli 
Ministry of Health” and the CDC have investi- 
gated this association.” The risk appears to be 
highest among young men.*°?” We found that 
the risk of myocarditis increased by a factor of 
three after vaccination, which translated to ap- 
proximately 3 excess events per 100,000 persons; 
the 95% confidence interval indicated that val- 
ues between 1 and 5 excess events per 100,000 
persons were compatible with our data. Among 
the 21 persons with myocarditis in the vaccinated 
group, the median age was 25 years (interquartile 
range, 20 to 34), and 90.9% were male. 

Another vaccine-related adverse event that has 
recently received attention in the medical litera- 
ture is Bell’s palsy. In a recent article based on 
publicly available data from the BNT162b2 and 
mRNA-1273 vaccine trials, Ozonoff et al.” sug- 
gested a possible association between these vac- 
cines and Bell’s palsy and estimated a rate ratio 
of approximately 7.0. This conclusion differed 
from the Food and Drug Administration briefing 
on these vaccines in December 2020; that brief- 
ing considered the incidence of Bell’s palsy to be 
similar to the background incidence.’ A small 
number of cases of Bell’s palsy after Covid-19 
vaccination have also been reported in the litera- 
ture.” In the current study, the effect estimate 
was consistent with a potentially mild increase 
in the risk of Bell’s palsy after vaccination, with 
a risk ratio of 1.32 (95% CI, 0.92 to 1.86). The 
absolute effect was small, with up to 8 excess 
events per 100,000 persons being highly com- 
patible with our data according to the 95% con- 
fidence interval. Herpes zoster infection, the inci- 
dence of which we found to be increased after 
vaccination, is one of the potential causes of 
facial-nerve palsy.” 

Another particularly notable class of adverse 
events that has been reported in the context of 
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3,455,926 Participants (CHS members of relevant age during 
study period) were considered for inclusion 
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3,330,435 Were not health care workers and were =16 yr of age during 
the specific study period, and were included in the derivation group 
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PCR-positive result for SARS-CoV-2 before May 24, 2021, 
216 yr of age at index date, and no previous vaccination? 





















































Yes No 
Y Y 
248,603 (7.5%) Were potentially eligible for 3,081,832 (92.5%) Were potentially 
the SARS-CoV-2 PCR-positive group eligible for the control group 
5612 (2.3%) Were confined to the 
home or were nursing home residents 
Y 





242,991 (97.7%) Were not confined to 
the home and were not long-term care facility 
residents as of index date 








7614 (3.1%) Did not have 


continuous CHS membership 
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235,377 (96.9%) Had continuous 
CHS membership as of index date 

















1985 (0.8%) Did not have BMI data 


or mapped home address available 
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233,392 (99.2%) Did not have missing 
data on BMI or on mapped home address 
and were eligible to be included in the 
SARS-CoV-2 PCR-positive group 


i i 


56,422 (24.2%) Were not matched 176,970 (75.8%) Were matched 
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13,333 Were matched as 
controls before 
PCR-positive result for 

















SARS-CoV-2 
Y 
173,106 Were included . , 173,106 Were included 
in the SARS-CoV-2 1:1 Matching in the noninfected |«— 


=—_——j7Tr- 
control group 











PCR-positive group 


9469 Were rematched to the 
SARS-CoV-2 PCR-positive group |~<— 


after contracting Covid-19 
































Covid-19 vaccines is thromboembolic events. These Covid-19 vaccines,” both of which are adenoviral 
adverse events, which primarily affect young wom- vector vaccines. However, we did not find an as- 
en, have been linked with the ChAdOx1 nCoV-19” sociation between the BNT162b2 vaccine and 
and Ad26.COV2.S Johnson & Johnson-Janssen) various thromboembolic events in this study. 
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Figure 2 (facing page). Study Population for the SARS- 
CoV-2 Analysis. 

Absolute numbers and percentage changes are shown 
for each inclusion and exclusion criterion. The chart fo- 
cuses on the SARS-CoV-2—infected population. The der- 


ivation group includes the entire population, including 
uninfected persons. The shaded boxes indicate the two 
study groups. The same exclusion criteria were applied 
to the uninfected persons for each index date on which 
they were considered for matching. Covid-19 denotes 
coronavirus disease 2019. 


Some initially unexpected effects were seen 
in the results of the current study. The BNT162b2 
vaccine appears to be protective against certain 
conditions such as anemia and intracranial hem- 
orrhage. These same adverse events are also iden- 





tified in this study as complications of SARS-CoV-2 
infection, so it appears likely that the protective 
effect of the vaccine is mediated through its pro- 
tection against undiagnosed SARS-CoV-2 infection, 
which may be undiagnosed either because of a 
lack of testing or because of false negative PCR 
results. 

This study has several limitations. First, per- 
sons in the study were not randomly assigned 
according to exposures (vaccinations and SARS- 
CoV-2 infections); this may have introduced con- 
founding at baseline and selection bias at censor- 
ing, especially since a single set of confounders 
was used for adjustment in the assessment of many 
disparate adverse events. Second, the matching 
process that was necessary to attain exchange- 
ability between the study groups resulted in a 
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Figure 3. Risk Ratios for Adverse Events after Vaccination or SARS-CoV-2 Infection. 


Estimated risk ratios for adverse events after vaccination or SARS-CoV-2 infection are shown. The risk ratio on the y axis is presented on 
a logarithmic scale to facilitate comparison of both increased and decreased risk. I bars indicate 95% confidence intervals. 
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study population with a different composition 
than the eligible population (e.g., median age, 
38 years rather than 43 years). Because this dif 
ferent composition changes the population over 
which the causal effect is being estimated, dif 
ferent estimates might be found for adverse 
events for which the incidence may differ sub- 
stantially between subgroups (e.g., myocarditis). 
Also, we excluded certain populations (such as 
health care workers and persons residing in long- 
term care facilities) that could be at particularly 
high risk for certain adverse events. Both of these 
issues should be taken into account when con- 
sidering the generalizability of the findings. 
Third, some diagnoses that were recorded in 
out-of-network hospitals, which were delayed in 
being reported to the insurer and were not entered 
by the person’s general practitioner from the hos- 
pital discharge notes into the outpatient medical 
record, could have been missed. Fourth, it is 
possible that persons are more likely to increase 
their levels of clinical awareness, concern, or both 
after vaccination or SARS-CoV-2 infection, and 


thus they may be more likely to report or seek 
medical care for their symptoms, resulting in a 
spuriously increased incidence of the various ad- 
verse events in the vaccinated or infected groups. 
Similarly, among persons with SARS-CoV-2 in- 
fection, the spike in the incidence of certain 
adverse events in the first day of follow-up could 
indicate the initial clinical manifestation of the 
infection, but it could also be related to active 
testing for SARS-CoV-2. Fifth, all the effect mea- 
sures that we presented are based only on a new 
incidence of the specific adverse event under study; 
thus, less light was shed on the potential addi- 
tional risk among persons with a medical history 
of each of these adverse events. However, this 
choice was necessary to distinguish between true 
new diagnoses of a given adverse event and recod- 
ing of past diagnoses and to ensure the accuracy 
of the adverse-event labels. 

In this study, we sought to place the increased 
risk of adverse events caused by the BNT162b2 
vaccine in context by contrasting this risk with 
that of the same adverse events after documented 
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Figure 4. Absolute Excess Risk of Various Adverse Events after Vaccination or SARS-CoV-2 Infection. 


Point estimates of the risk differences for selected adverse events are shown. Estimates were derived 42 days after 
vaccination or SARS-CoV-2 infection with the use of the Kaplan—Meier estimator. Risk differences are shown per 
100,000 persons and rounded to the nearest integer. Negative differences (decreased risk) are represented as nega- 
tive values on the y axis, and positive differences (increased risk) are represented as positive values on the y axis. 


The abbreviation mRNA denotes messenger RNA. 








N ENGL J MED 


NEJM.ORG 


The New England Journal of Medicine 
Downloaded from nejm.org on August 26, 2021. For personal use only. No other uses without permission. 
Copyright © 2021 Massachusetts Medical Society. All rights reserved. 


BNT162B2 MRNA VACCINE IN A NATIONWIDE SETTING 


infection with SARS-CoV-2. We thought that this 
was necessary because vaccination and its poten- 
tial risks do not occur in a void but rather in the 
context of an ongoing pandemic. Although the 
general risks of hospitalization, severe disease, 
and death from Covid-19 are widely recognized, 
secondary complications of infection are less well 
known. Therefore, in this analysis, we sought to 
estimate the effects of SARS-CoV-2 infection on 
the incidence of the same list of adverse events 
examined in the vaccination analysis. Because 
the cohorts that we used to study the vaccine and 
infection effects were different in composition, 
care should be taken when comparing the re- 
sulting risk estimates. In addition, knowledge of 
these risks alone is insufficient for a complete 
decision-theoretic analysis. When a person de- 
cides to become vaccinated, this choice results in 
a probability of 100% for the vaccination, whereas 
the alternative of contracting SARS-CoV-2 infec- 
tion is an event with uncertain probability that 
depends on the person, place, and time. More- 
over, infection with SARS-CoV-2 has many other 
adverse effects beyond those considered here, in- 


cluding the risk of transmission to family mem- 
bers and others. 

We estimated that the BNT162b2 vaccine re- 
sulted in an increased incidence of a few adverse 
events over a 42-day follow-up period. Although 
most of these events were mild, some of them, 
such as myocarditis, could be potentially serious. 
However, our results indicate that SARS-CoV-2 in- 
fection is itself a very strong risk factor for myocar- 
ditis, and it also substantially increases the risk 
of multiple other serious adverse events. These 
findings help to shed light on the short- and 
medium-term risks of the vaccine and place 
them in clinical context. Further studies will be 
needed to estimate the potential of long-term 
adverse events. 


Because of data privacy regulations, the raw data for this 
study cannot be shared. 
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